Evolving context-free language predictors
نویسندگان
چکیده
Recurrent neural networks can represent and process simple context-free languages. However, the diiculty of nding with gradient-based learning appropriate weights for context-free language prediction motivates an investigation on the applicability of evolutionary algorithms. By empirical studies , an evolutionary algorithm proves to be more reliable in nding prediction solutions to a simple CFL. Moreover, the evolutionary algorithm demonstrates greater diversity by making use of a larger repertoire of dynami-cal behaviors for solving the problem.
منابع مشابه
Dynamic Interpretations of Constraint-Based Grammar Formalisms
We present a rendering of some common grammatical formalisms in terms of evolving algebras. Though our main concern in this paper is on constraint-based formalisms, we also discuss the more basic case of context-free grammars. Our aim throughout is to highlight the use of evolving algebras as a speci cation tool to obtain grammar formalisms.
متن کاملImproving procedures for evaluation of connectionist context-free language predictors
This letter shows how seemingly minor differences in training and evaluation procedures used in recent studies of recurrent neural networks as context free language predictors can lead to significant differences in apparent network performance. We suggest standard evaluation procedures whose use would facilitate better reproductibility and comparability.
متن کاملLoughborough University Institutional Repository Evolving
A list of requirements for a genetic programming representation is put forward and a representation separating the genotype and phenotype with a linear genome is presented. The target language for the genetic program is Perl. The mapping process, between the genotype and phenotype, converts blocks of four genes into program statements. This process is context-free and therefore provides inherit...
متن کاملEvolving Stochastic Context-Free Grammars from Examples Using a Minimum Description Length Principle
This paper describes an evolutionary approach to the problem of inferring stochastic context-free grammars from nite language samples. The approach employs a genetic algorithm, with a tness function derived from a minimum description length principle. Solutions to the inference problem are evolved by optimizing the parameters of a covering grammar for a given language sample. We provide details...
متن کاملLoughborough University Institutional Repository Evolving Perl
A list of requirements for a genetic programming representation is put forward and a representation separating the genotype and phenotype with a linear genome is presented. The target language for the genetic program is Perl. The mapping process, between the genotype and phenotype, converts blocks of four genes into program statements. This process is context-free and therefore provides inherit...
متن کامل